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Qualitative Validation’of IMM 4.0- -— 


Background 


¢ Purpose 

— To perform a qualitative assessment of the predictive performance of 
IMM 4.0 with respect to ISS Real World System (RWS) referent data 

— Qualitative assessment based on the ability of IMM to predict total 
medical events (TME), specific medical condition incidence, and 
medical resource utilization 

— IMM 4.0 functionalities of timeline, partial treatment capability, and 
alternative medication capability 
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Methods 


¢ Data Acquisition 
— Formal request from IMM project to Lifetime Surveillance of Astronaut 
Health (LSAH) to obtain in-flight medical data for ISS missions 
— Data requested 
¢ Crew member health history including medical waivers for spaceflight 
¢ Mission duration and number of Extravehicular Activities (EVAs) 
¢ All medical events captured for each crew member 
¢ Flight days and duration of medical events 
¢ Medications used to treat each medical event 
¢ Crew member response to medication treatment 
¢ Additional information regarding medical events, including severity and 
comments from crew members, crew medical officers, and flight surgeons 
— Data obtained from 31 ISS missions encompassing ISS Expeditions 14 
through 39/40. 
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Methods 


¢ Data Organization of ISS Medical Events 
— Data sorted by crew member 
— Each crew member assigned a unique identification number 
— Medical events characterized by type 


— Additional medical event information included mission day of occurrence, 
duration, medications utilized for treatment, and additional notes 


— Each medical event was mapped to an IMM medical condition if possible 


— lf the medical event could not be mapped to a current IMM medical condition, it 
was captured as a potential future IMM medical condition 
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Methods 


¢ Data Organization of ISS Medication Utilization 


— Medications grouped by categories 
1. Antacid 
2. Antibiotic 
3. Antidiarrheal 
4. Antiemetic 
5. Antifungal 
6. Antihistamine 
7. Antiviral 
8. Decongestant 
9. Hypnotic 
10. Laxative 
11. Non-opioid Analgesic 
12. Ophthalmic 
13. Opioid Analgesic 
14. Steroid 
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Methods 


¢ Preparation for Validation Analysis 

— All medical events per mission summed by condition 

— Total number of medications reported as utilized summed by category 

— Medication category sums ranked numerically from most frequently to 
least frequently utilized 

— Mission duration for each crew member converted from days to years 

— Number of EVAs per mission summed to obtain total EVAs 

— Crew members with no reported medical data were excluded from 
analysis 
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Methods 


¢ IMM Simulation 
— IMM 4.0 was used to simulate each of the 31 RWS ISS missions 
— An IMM simulation was performed for each ISS mission based on the 
corresponding mission profiles 
¢ Mission length 
¢ Number of crew 
¢ Sex of each crew member 
¢ Number of EVAs 
¢ Presence of eye contacts 
¢ Presence of dental crowns 
¢ CAC score 
¢ History of abdominal surgery 
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Methods 
Qualitative Comparison 


Performance Characterization of Qualitative Parameters 


Parameter Visualization Performance Characterization 


Total Medical Events Spider Plots/Linear Plots IMM TME should be reasonable estimate 


of RWS TME 
Medical Conditions: Bar Charts IMM incidence values should be of similar 
Incidence magnitude as RWS incidence values 
Medical Resources Tabulation of resource IMM resource utilization ranking should be 
rankings consistent with RWS resource utilization 
ranking 
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Methods 


Qualitative Comparison 


Total Medical Events 

— RWS TME compared to IMM forecasted TME per ISS mission 

— Observed values of TME were compared to predicated means and 90% 
confidence limits for each ISS mission 

IMM forecasted TME classified as in-range or out-of-range for each ISS mission 
based on 90% confidence limits 


— Out-range- forecasts further classified as overestimates or underestimates of TME 
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Methods — Qualitative Comparison 
Medical Conditions: Incidence 


Incidence values were expressed as either a rate (events/person-year) or 
as a proportion (events/person) 

If IMM incidence values differ significantly from RWS incidence values, IMM 
predictions of medical events an associated end-states (EVAC and LOCL) 
would be expected to differ 


Qualitative Evaluation Criteria 
1. The ratio of IMM vs RWS incidence values assessed by order of magnitude [less 
than 0.1(low) or greater than 10 (high)| 


2. The ratio of IMM vs RWS incidence values assessed by ratio difference 
[less than 50% (low) or greater than 150% (high)] 


Zero-event Data 
— For rare medical events in IMM that have not occurred on RWS ISS missions, an 
estimation of the upper bound for the incidence was used (1/2.5n)* 


* Quigley and Revie, 2011 
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Methods — Qualitative Comparison 
Medical Resources 


¢ Only medications were considered for analysis 
— RWS data for non-medication resources are very limited 
— Medications were grouped by category 


¢ Ranked IMM forecasted medication utilization was compared to 
ranked RWS ISS medication utilization 
— Excellent (< 2 difference in relative ranking positions) 
— Fair (3-5 difference in relative ranking positions) 
— Poor (2 5 difference in relative ranking positions) 


Results 


Total Medical Events 
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Results 


Total Medical Events 


¢ IMM estimated TME were in-range for 58% (18 out of 31) of the RWS ISS 
missions 


¢ IMM overestimated TME for 39% (12 out of 31) of the RWS ISS missions 


¢ IMM underestimated TME for 3% (1 out of 31) of the RWS ISS missions 
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Results 
Incidence Values 
¢ IMM incidence values were in-range for 74% (87 out of 118) of the RWS ISS 
medical conditions 


¢ IMM incidence values were out-of-range high for 22% (26 out of 118) of the 
RWS ISS medical events 


¢ IMM incidence values were out-or-range low for 4% (5 out of 118) of the 
RWS ISS medical events 


Qualitative Validation of IMM 4.0. — 


Results — Medical Resource Utilization 


RWS Rankings IMM Rankings Quality of Match 
1. Non-opioid Analgesic Non-opioid Analgesic Excellent 
2. Hypnotic Hypnotic Excellent 
3. Decongestant Antibiotic Poor 

4. Antihistamine Antihistamine Excellent 
5. Antiemetic Ophthalmic Excellent 
6. Antifungal Antiemetic Excellent 
7. Ophthalmic Decongestant Fair 

8. Laxative Antidiarrheal Fair 

9. Steroid Antifungal Fair 

10. Antibiotic Laxative Excellent 
11. Antiviral Opioid Analgesic Fair 

12. Antacid Antacid Excellent 
13. Antidiarrheal Steroid Fair 

14. Opioid Analgesic Antiviral Fair 
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Results - Medical Resource Utilization 


Excellent Consistency [50%] (7 out of 14 medication categories) 
— Analgesic 

— Antacid 

— Antiemetic 

— Antihistamine 

— Hypnotic 

— Non-opioid Analgesic 

— Ophthalmic 

¢ Fair Consistency [43%] (6 out of 14 medication categories) 
— Antidiarrheal 

— Antifungal 

— Antiviral 

— Decongestant 

— Opioid Analgesic 

— Steroid 

Poor [7%] (1 out of 14 medication categories) 

— Antibiotic 
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Summary of Results 


TME 
¢ The IMM forecasted TME were consistent with the TME for ISS 
¢ When inconsistent, the IMM tended to overestimate the TME for ISS 


Incidence Values 
¢ IMM incidence values were consistent with the ISS incidence values 


¢ When inconsistent, the IMM incidence values were generally higher 
than ISS incidence values 


Medical Resource Utilization 


¢ IMM forecasted medication utilization was generally consistent with 
medication utilization on ISS 


¢ IMM overestimated the use of antibiotics on ISS 
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Conclusions 


¢ IMM 4.0 forecasts of TME, Incidence Values, and Medication Utilization 
are overall consistent with the ISS RWS 

¢ Inconsistencies found between the IMM and the RWS may be used to 
adjust model inputs and improve the ability of the IMM to accurately 
simulate the RWS 


